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ITEM IDENTITIES AND THEIR RELATED OBSERVABLES 



D. P. Gaver 
P. A. Jacobs 



Abstract 

Each of J items has a characteristic Signature which varies in time. At 
time 0, the value of a Signature and the identity of the corresponding item are 
known. No further values of Signatures are observed until a later time t>0. 
At time t, a Signature from an unknown item is observed. The problem is to 
estimate the identity of the item whose Signature is observed at time t. The 
estimation procedure studied is to estimate the identity of the unknown item 
to be that one which maximizes the posterior probability of producing the 
observed Signature. 

Key Words: Classification; Bayesian Paradigm; autoregressive process 



ITEM IDENTITIES AND THEIR RELATED OBSERVABLES 



D. P. Gaver 
P. A. Jacobs 



1. The Problem 

We are concerned with a diagnostic problem that may occur in many 
applied areas, with medicine and mechanical system reliability furnishing 
handy examples. 

Suppose there are J Items (e.g., diseases or faults), each of which has a 
characteristic Signature which varies in time; the Signature of Item i is 

i _ J 2 T 

Yj(t) = 0j + Xj(t) t = 0 1 2 (Id) 

For the moment (Xj(t)} is an unspecified univariate stochastic process, but one 
that loosely, has the property of staying near 0j in finite time, and for 
convenience has some stationary or steady-state behavior. One could think of 
Yj(t) as a physical index characteristic of a particular disease or disability, e.g., 
blood pressure, heart-beat pattern, mechanical vibration spectrum, etc. 

Suppose that Yj(t) is only evident or observable occasionally at times 
unrelated to the magnitude of Yj(t), but driven by other forces (this is a bit 
implausible in some situations because a high blood pressure or temperature 
may actually induce medical observation; the formulation can be changed to 
reflect this later). Suppose that the Signature and the identity of an item are 
both observed at time t=0. Suppose that later on, at time t, only the Signature 
of an item is observed. The first question is: what is the probability that, 
given the Signature value observed, its originating item is any particular one 
of a list of candidates, e.g., i=13 out of a particular list j=l, 2, ... 13, ... J = 39? 
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2. Question: Who is Being Observed? 

Here we become quite specific, assuming for illustration that the 
Signature of Item j is AR(1): 



Yj(t) = Gj + Xj(t), 



( 2 . 1 ) 



where 



Xj(t) = pjXj(t-l) + 8j(t), t = 0, 1, 2, 17, ... (2.2) 

2 

with (£j(t)} ~ HD N (0,Oj). For the moment assume that the basic constants 0j, 
j = 1, 2, ..., J are known, as are the correlations I pj I <1 and the variances Oj. 

If I pjl <1 then, given Xj(0), Xj(t) is Normal/Gauss 





f 


", 2t" 


\ 


Xj(t) 1 Xj(0) ~ N 


Xj(0)pj, G- (t) = Gj 

l 


1— Pj 
, 2 






L 1_p jJ 


J 



or, in terms of the actual observable Yj(t), 

Yj(t) I Yj(0) ~ N((Yj(O)-0j)p| + 0j, G-(t)) (2.4) 

Apparently if t runs on indefinitely, its distribution approaches 

N^0j,a|(°o)| with g?(°°) = /j^l-p j j (2.5) 

Scenario: Suppose there are potentially J items around, but admit the 
possibility that each can vanish, so that there is some probability, which may 
be less than one, that the item will actually be "around" at time t. Let the 
probability that one, the jth, is present at t be pj (t). Next, let Sj(t) be the 
probability that the jth be observable, e.g., is emitting sounds, given that it is 
present; assume independence between items. All of this is preliminary, and 
can (and should) be modified as required. Now consider that event 

A) Item i has been observed at t=0, and its Signature is observed /noted to 
be Yj(0) = y(0). 



2 



If it has been a long time since an observation was made then it is 
plausible to take the probability of the above event as 



P{Yi(0) £(dy(0)), 1(0) = i} = P i(0) Si(0)cp 



y(0)-9j 1 

Oi(°°) Joi(°°) 



dy(0) 



(2.6) 



(p being the N(0,1) density; that is, we observe Item i after his Signature is in 
statistical equilibrium, and measure time from that (such an) instant. 



Time t elapses and then for any j (either the same as i, or different) 

B) Item j is observed at time t>0, with Signature value Yj(t) = y(t). 

Since the AR(I) process is Markov, we can write down the joint 
probability 



P{Yi(0) £(dy(0)), 1(0) = i, Yj(t) £(dy(t)), I(t) = j} = 

,~s fy(0)-0A dy(0) / x /x fy(t) - mj(tp\dy(t) _ 

Pi<°> SiCO) • Pi<t> Si (t) ^ 0j(t) (2.7) 

where we can think of pj(t) as the conditional probability that j is actually 
eligible for observation, and Sj(t) as the conditional probability of being 
observable. Note that it is natural for j*i that 



mj(t) = 0j 

Oj(t) = Oj(oo) = oj /^1-p^j 



(2.8,a) 

(2.8,b) 



for at t it is still a "long time" since j(*i) was last observed; whereas if j=i, the 
same item that was observed and identified at t=0, then 



m,(t) = 0j + (y(O)-0j) Pi 



(2.9,a) 



and 



2 2 
Oj(t) = Oj 



( ( 2 \\ 

1- Pi 



1_ P? 

V J 



(2.9, b) 



It follows that 
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C) the conditional probability of observing a particular item and 
observing it with Signature value y(t) given the initial condition Q(0) = 
{Yi(0),I(0)} is just 



P{Yj(t) £(dy(t)), I(t) = j I Cj(0) = (y(0), 1(0))} = 



Pj(t) Sj(t) <p 

where the appropriate mj(t) and Gj (t) come from (2.8) or (2.9). In words, (2.10) 
provides the probability of seeing or positively identifying a particular item, j, 
and simultaneously measuring its current Signature value, given such a 
complete observation at t=0. 



yyi; ~ mjVU A uyvo 
Oi(t) Oi(t) 



( 2 . 10 ) 



Next 



J 

D) P{Y(t) £(dy(t)) I Q(0)} = ^ P{Yj(t)8(dy(t)), I(t) = j I Q(0)} 



V m fy(t)-mj(th dy(t) 

oj(t) j^tj* 



( 2 . 11 ) 



This is the probability that one measures a Signature at t, but cannot make a 
complete identification. 

From (2.10) and (2.11) we can calculate the probability of the identity of the 
item whose signature is measured at time t, given the last complete 
observation: 



E) P(I(t) = j I Y(t) = y(t), Q(0)} = 



Pj(t) Sj(t) cp^ 
I 

Jpk(t) Sk(t) (p 



y(t)-mj(t) ^ 1 

Oj(t) j'Cj(t) 
^y(t) - mk(t) ^ 1 

^ Ok(t) J Ok(t) 



( 2 . 12 ) 



If one looks hard at (2.12) it seems clear that when pi>0 and y(t) is near 
y(0), and j=i, the above probability becomes closer and closer to unity as t 
decreases, while if j*i that probability (that Item j*i) correspond- 
ingly decreases. 
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3. The Probability of Making the Wrong Decision 

In this section we study properties of making a decision based on 
choosing the item which maximizes the posterior probability of a particular 
item being the one whose Signature is observed at time t given the last 
complete observation at time 0. For simplicity we will assume that there are 
two items whose parameters are 9j and 02 - 

3.1 The parameters 8i and 6^ are known. 

Suppose the parameters 9] and 02 are known and I pj I <1. The condi- 
tional distribution of Y(t) given Y(0) = y(0), 1(0) = 1, I(t) = 1 is normal with 
mean 



mi(t) = 0] + (y(0>— 0i)p * 



and standard deviation 



oi(t) = Ol(«) 




Further, 



Y(t)-m 2 (t) Y(t)-mi(t) + (mi(t)-m 2 (t)) 
02(t) ” 02(t) 

Ql(t) Y(t)-mi(t) mi(t)-m 2 (t) 
“ 02(t) G](t) + 02(0 



(3.1) 



(3.2) 



(3.3) 



where m 2 (t) and mi(t) are given by (2.8). 

Assume that item j will be identified with the Signature at time t if it 
maximizes (2.12); then. 



P (wrong item is identified 1 1(0) = 1, 1(t) = 1, Y(0) = y(0)} (3.4) 



= P^ 



P2<t)S2(t) (Si exp 

/ p,<t)s,(t) V^ exp 1 



1 (Y(t)-m2(t)) 

'2 2 
02(t) 

1 (Y(t)-mi(t)) 



<T](t) 



I(0)=1, 1(t)=l, Y(0)=y(0) 
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■ p 1St 5$ > ex P |4 22 + 5 ( c <« 2 + d^) 2 }} 



where Z has a standard normal distribution 



c(t) = 



Ql(t) 

a 2 (t) 






gl(°°) 
02 (°°) 



(3.5) 



and 



mi(t) - m 2 (t) + (e l ~ e 2> 

d 1 - 0 2 (t) “ O 2 (oo) 

P {wrong decision | 1(0) = 1, I(t)=l, Y(0) = y(0)} 



= P 



P2(t)s 2 (t) 

pi(t)si(t) 






Ol (<») 



CJ 2 (oo) 



> ex 



v{-\ [(l-c(t) 2 )Z2 - 2c(t)d(t)Z - d(t)2 ]} 



= P 



-2 In 



P2(t)s 2 (o y l-p ^ gi(oo) 

_pi(t)si(t) 0 2 (°°) 



< (l-c(t)2)Z2 - 2c(t)d(t)Z - d(t)2 



= P 



0 < (l-c(t) 2 )Z 2 - 2c(t)d(t)Z - d(t) 2 + 2 In 



P2<t)s 2 (t) r 2t~ gi(°°) 
pl(t)si(t) yf “^1 a 2 ( °°) 



(3.6) 



Note that as t— >0 




and thus 



P{wrong decision I 1(0) = 1, 1(t) = 1, Y(0) = y} — » 0. 

Example: Suppose o\ = o i = 1,2, I pi I = I p I <1, i=l,2 and pi(t)si(t) = p 2 (t)s 2 (t); 
then 



P{wrong decision I 1(0) = 1, 1(t) = 1, Y(0) = y(0)} 

= P {0 < (1— c(t) 2 )Z 2 - 2c(t)d(t)Z - d(t) 2 + 2 In c(t) } (3.7) 
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with 



c(t) = VT^2t 



(3.8,a) 



and 



(y(O)-0i)pt + (0i-e 2 ) 
d(t)= c / v ^ 



(3.8,b) 



( 01 - 02 ) 

As t — d(t) — > , — , c(t) — >1 and 



a/Vl-p 2 

P{wrong decision I 1(0) = 1, 1(t) = 1, Y(0) = y(0)} 

fld(~)| 



1-0 



-I 



(3.9) 



where O is the standard normal distribution function. In this case, the 
conditional probability of making a wrong decision decreases as ! 0 1— 0 2 I 
increases and the probability increases as a increases. 

For arbitrary t > 0 such that c*l, 

P{wrong decision I 1(0) = 1, 1(t) = 1, Y(0) = y(0)} 



= P 



= Pi 



= P1 



( c(t) d(tr 


Q. d(t) 2 2 In c(t)| 






' > (1— c(t)2) 2 ” 1_c(t)2 J 




„ c(t) d(t) 


/ d(t) 2 2 In c(t) 


Z "W 


\ (1-C<t)2) 2 1_C( 


t) 2 


„ c(t) d(t) 


^ /d(t) 2 ln(l-p20 


► 


Z -T^(i)5- 


> \ p 4 ‘ " p 2 ‘ 





= 1 - O ( VI^2t p-2td(t) + k(t)) + O ( Vl-P 2t p- 2t d(t) - k(t)) 



(3.10a) 



where 



k(t) = [d(t) 2 p- 41 - p-2t In (l-p 2t )] 2 - 



Note that as t-»0, c(t)-»0 and the conditional probability of an incorrect 
decision tends to zero. 
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A numerically more stable form of (3.10a) is the following. 

P{wrong decision 1 I(0)=1, I(t)=l,Y(0)=y(0)) = 1 -<I>(Ai)+<I>(A 2 ) (3.10b) 



where 

A! = [-d(t) 2 + 21n c(t)] [c(t)d(t) - Vd(t) 2 -(l-c(t) 2 )21n c(t)] ^ 

A 2 = [— d(t) 2 + 21n c(t)] [c(t)d(t) + Vd(t) 2 - (l-c(t) 2 )21n c(t)] 

The unconditional probability of a wrong classification can be found by 
taking the expected value of (3.10b) with respect to the normal random 
variable Y(0) with mean 0i and standard deviation o(«>). The evaluation of 
the integrals is performed numerically using Gauss-Hermite quadration with 
59 points; cf. A. H. Stroud et al [1966] and Naylor and Smith [1982]. Figures 1 
and 2 show the unconditional probability of wrong classification at time 1, 2, 
..., 100 for parameter values 0i = 1, 02 = 2, a = 1 and values of p = 0, 0.5, 0.8, 0.90, 
0.95. (resp. curves A, B, C, D, E). 

Figure 1 shows the probability of wrong classification. As noted above, 
the probability of wrong classification is small for small values of t and then 
increases to a limiting value. For very small times having a larger p results 
in smaller probabilities of error. It is seen from (3.9) that the limiting value is 

a function of o(°°) = o/^/ 1-p 2 . Hence the larger p is the larger the limiting 
probability of wrong classification. Thus, while for very small times, having a 
large positive p decreases the probability of wrong classification, at larger time 
it increases the probability of wrong classification. 

In Figure 2, each probability of wrong classification is divided by its 
asymptotic value. These normalized probabilities are between 0 and 1. The 
fraction (relative to the limiting probability) of the probability of wrong 
classification for each time t is monotone in p. For a fixed time t, for a high p, 
the fraction of the probability of wrong classification is less than or equal to 
that for a lower p. The higher p is, the longer it takes for the probability of 
error to reach its asymptotic value. 

3.2. The parameters 0i and 0 2 have noninformative priors. 

In this subsection we will assume that 0i and 0 2 have noninformative 
prior distributions. Thus, assuming I pi I <1, 
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Fi gure 



NORMALIZED PROB(WRONG CLASSIFICATION) 
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Figure 



(3.11) 



p{y( 0) edy(O), eedel 1(0) = 1 } 

= exp H (y<0) ■ e ) 2/o '<“> 2 } d y (°> d6 • 

Hence, formally for a non-informa tive improper prior, 
P (Y(O)edy(O) 1 1(0) = l} = l-dy(0) 
and thus 



P {eedel 1(0) = l,Y(0) = y(0)} 

ex p{4( e -y (0 >) 2 /°' ( “ >2 } de - 

Further, 



P (Y(t)edy(t), 6ed0 1 I(0)=1, 1(t)=l, Y(0)=y(0)} 

= exp H ( y<t> " e ' p ' <y<0> ' e) J /o,<,) 1 

x exp {4( 0 -y<°>) 2 /°iw 2 } 

= ex p{-2( e -p> (t) ) /v i (,)2 -l R } 



where the usual calculations yield 




" ! “2 = fy(t) ~ p\ y(0)l ^ — 2 ~ + y(0)/ai(«») 
vi (t) V ) 01 (t) 



1-Pl 



(3.12) 



(3.13) 



(3.14) 



(3.15) 



(3.16) 
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(3.17) 



[y(t) - y(0)] 2 = [y(t)-y(0)] 2 /2 j^l-pi ojC 



R v l (t) 

1< = 2 2 

aiM oi(t) 
ai (oo) 2 = a 2 / ^ 1- p lj 

ai(t) 2 = fl-pflai(«») 2 
V 7 

Hence, 

P {Y(t)£dy(t) I 1(0) = 1, 1(t) = 1, Y(0) = y(0)} 






1-p‘l 



1 2 
exp j — 2 (y(t) - y (0)) / 2 



ai(~r 



1-Pl 



Ol(oo) 



Similarly 

p{Y(t)edy(t),0ed6 1 1(t)=2, 1(0)=1, Y(0)=y(0)} 

.21 



= V2T02W eXP (^ <y<,> ^ )2/02< ” 



>) 



dy(t)d0 



and 



P (Y(t)edy(t) I I(t)=2, 1(0)=1, Y(0)=y(0)} = l-dy(t) 
where a 2 ( oo ) = o 2 / ^-p 2 j- 

Suppose item j is estimated to be the one observed at time 
maximizes 



p{l(t)=j 



I(0)=1, Y(0) = y(0) 



Y(t)=y(t)} 



It follows that 



P {item 2 is chosen I I(0)=1, Y(0)=y(0), I(t)=l} 



(3.18) 

(3.19) 

(3.20,a) 



(3.20,b) 
t if it 
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= P ^ p 2 (t)s 2 (t) > pi(t)si(t) -j= ex 

{ V 271 cxi(t) 



v{~\ (Y(t>— y(0)) 2 / di(t) 2 } 1 1(0)=1, 1(0=1, Y(0)=y(0) 




= PJ -2 In y[2 n 



v 




(3.21) 



where Z is a standard normal random variable and oi](t) 




1-P! Oi(oo). 



Note that as t-»0, the probability of choosing the wrong object tends to 0. 
If 



where O is the standard normal cdf. Note that (3.23) is independent of y(0). 
As ai increases, the conditional probability of making the wrong decision 
increases. Similarly as t increases the probability of making the wrong 
decision increases. As pi(t)si(t) decreases, the probability of making the wrong 
decision also increases. 

In the case in which pi(t) S](t) = p2(t) S2(t), Pi = P 2 = P>0, and O] = 02 = a 




(3.22) 



then the conditional probability of making the wrong decision is 1. 
If k(t) < 1 then 

P {item 2 is chosen I I(0)=1, Y(0)=y(0), I(t)=l } 

= 2[l-0(-2 ln(k(t)))] 



(3.23) 
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For t = 1, k(t) and hence the probability of error decreases as p increases. For 

t = 2, k(t) = V2 n a for all values of p and so the probability of choosing the 
wrong item increases as a function of t. The limiting value of k(t) as 

once again depends on g(°°) = o/y 1-p 2 . Hence as p increases the limiting 
probability as t— »<*> of choosing the wrong item increases. Figure 3 displays the 
probability of choosing the wrong item for a = 0.1 and p = 0, 0.5, 0.8, 0.9, 0.95 
(resp. curves A, B, C, D, E). Note that for t>2, it is p = 0 that has the smallest 
probability of incorrect identification. These results depend on the specific 
prior (3.20,b). In the next subsection we will consider Gaussian priors. 

3.3 The parameters 0i and 02 have Gaussian priors 

In this section we will assume 0i has a normal prior with mean pt and 
variance X x ,i = 1,2. Thus, assuming I p, I <1, 



P {Y(0)edy(0), 0ed0 1 l(0)=l} 



V 2ft oi( OO ) V 2 k Tl 



exp 



1 (y(O)-e ) 2 _l (6-Pi) 2 



dy(0)d6 (3.24) 



V 2tc oi( OO ) V 2jt X\ 



exp' 



1 (O-mi(O)) 1 

-9 2 “9 R l( 0 ) 

2 V!(0) 2 



• dy(O)d0 



where straightforward calculations yield 



, -2 1 1 
VI (0) = ~2 + 



. ,2 2 



2 “ 2 2 
x\ oi(«>) Xi ai(co) 



(3.25) 



(3.26) 



mi(0) = 



(y(0)/oi(oo) 2 ) + fpi/x 2 



vi( 0 ) 



2 2 

Tj y( 0 ) + a 1 (00) p! 

: 7~7 2 
01 (®°) + x 1 



(3.27) 
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Fi gu re 



Ri(0) = 



(3.28) 



O]0 



1 2 

~2 — 2 (y( 0 ) - m) • 

co) + T] 



with 



, ,2 2/ 2^\ 

ai ( oo ) = G ]/ 1 — p ! 






y 



Therefore, 

P {0ed9 1 1(0)=1, Y(0)=y(0)} = -==A exp 

V 2 tt vi( 0 ) 

Similarly, from (2.4) 

p{Y(t)£dy(t), 0£d0 1 1(0)=1, 1(t)=l, Y(0)=y(0)} 

1 



1 (0-mi(O)) 
2 

2 vi(0) 



V 2k Oi(t) 



exp 



(y(t) - 0 - p](y(O)-0)) 2 /ai(t) 2 



;== — — expl-x (0-mi(O)) 2 /vi(O) 2 } dy(t)d0 
271 vi (0) l z J 



V vi(0) 

1 1 

V 2k ai(t) V 2 k vi(0) 



exp 



1 (0-ai(t)) ! 

"2 2 2 

2 ^i<t) 2 



> dy(t)d0 



where 

—2 rr 1 2 2 "i -i 

^l(t) = ||(l-pi) M(t) J + VI ( 0 ) 

( I - Pi ^ ytt - P ^ o )] mi(0) 

2 +2 
CTl(t) Vi (0) 

and 



ai(t) = ^i(t) 2 



(3.29) 



(3.31) 

(3.32) 

(3.33) 
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Ri(t) = 



(y(0-p t iy(o))-m 1 (o)(i-p t 1 ) 



$i(t) 

5 T 

Oi(t) vi (0) 



(y(t)-piy(0))-mi(0)(l-p t 1 ) 



A (i-p t 1 ) 2 vi(0) 2 + oi(t) 2 



(3.34) 



with 



2 2 2t 2 

G](t) = O] (1-pl )/(l— pi). 



Thus, 



P (Y(t)edy(t) I Y(0)=y(0), I(0)=1, 1(t)=l} 

- VaTtU.) exp l^ <y(t) - , ‘ ,<t » 2/t,<t > 2 } 



where 

(l-p\) 2 vi(0) 2 +oi(t) 2 

(l-p 2 ] ‘)ai(oo) 2 + x\ 2(l-pi) 
= G](oo) 2 2 : 

Gl(oo) +tj 




(3.35) 



(3.36) 



= (1— pj) Gi (°°) 2 





(2 t 2\ 


2 , v 2\ 


1 + 


T 1 + Pi a l(°°) / 


1 X\ + Ol(oo) 


_ 


l ) 


V ) 



and 



Pl(t) = Piy(0) + mi(0) (1-Pi) 



(3.37) 



17 



piy(o) 



2 2 
ai (~>) + X] 



x 2 y (0) + ai (oo) 2 ^! j (l - pj) 



77 2 

ai (°o) + 1! 



x 2 y(0)+ai(oo) 2 pi J+pi y(0)|ai(oo) 2 + x\ j - j^x^y(O) + ai(«») 2 m 

< 7 2 

01 ( 00 ) +x 1 



2 2 t 2 

X! y( 0 ) + 01 (00) pj + p !Oi(oo) [y( 0 )-|J . 1 ] 

; 77 2 

Oi (00) + X] 



2 t 
moi(oo) ( 1 — p j) + y( 0 ) 



2 ‘ / x 2 

X! + p]Oi(oo) 



77 2 " 

Ol(~) + X! 



Similarly, 

P (Y(t)edy(t) I Y(0)=y(0), I(0)=1, 1(t)=2> = 
where 

2 2 2 
X2(t) = 02(°°) + X 2 



V 2jc X2(t) 



exp 



< I 



(y(t)-p2(t)) 



2 2 

X2(t) 



(3.38) 



(3.39) 



and 



H2(t) = M-2- 



(3.40) 



Once again we will estimate the identity of the item that was observed at 
time t to be that item j for which 



Pl ^7t j (t) ex P { ~\ (y(t) " Pj(0) 2 /Xj(t) 2 } 



(3.41) 
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is the largest. 

Thus, 

P {choose item 2 1 Y(0)=y(0) , I(0)=1, I(t)=l} 
- P { exp { -\ ( Y(t) - p 2 (t)) 2 /t 2 (0 2 } 

.2 . .2 



pi(t)si(t) 



> f Xi(t) exp { - 2 (Y(t)-jii(t)) /xi(t) 

= p { p ^ t 2 ) ( S t f ) ex p{ 4 (c(t)z + d(t))2 }> pi x?a) (t) ex p{-| z ' 



V(0)=y(0), 1(0=1, 1(t)=l 
1 2 



where Z is a standard normal random variable. 

,.v 

oiM -yj l-p‘, 



V 



.2 2 



' 


(2 t , 2> 


/ 2 2 VI' 


1 + 


T 1 + Pl^U 00 ) 


/X!+Oi(oo) 


- 


V J 


V / 



and 



d(t) = 



Pl(t)-P2(t) 

T2(t) 



1 



V 



, ,2 2 
02 \°°) + 12 



t 2 2 

p^ytO-pi) oiM + (y(0) - P 2 ) x i + (pi-p 2 > oi(~) 

7"? 2 

ai(oo) +x, 



Hence 

P {choose item 2 1 Y(0)=y(0) , I(0)=1, I(t)=l} 



= P -2 In 



ksct < z 2 - 2c<, > d(t)z - d< * )2 } 



(3.42) 



(3.43) 



(3.44) 



(3.45) 
2 “ 



(3.46) 
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= p. 



d(t) 2 



• l-c(t)2 
if I c(t) I <1 



-2 In 



P2(t)S2(t) 
. C(t) pi(t)si(t ) p 



z - c(l)d(,) ' 



V 



v 



l-c(t) 



y 



If pi(t) si(t) = 0, then item 2 will always be chosen. Assume pi(t) S](t) > 0. 
If p 2 (t)s 2 (t)=0, then clearly item 2 will never be chosen. In what follows 
assume 

pi(t) si(t) and p 2 (t) S 2 (t) are both positive. Note that as t-»0, xi (t) — >0, c(t)-*0 
and 



P {choose item 2 I Y(0)=y(0) , 1(0=1, I(t)=l}->0. 

Also, as X2— >°° and/or O 2 ( oo )-> <x> , c(t)-*0, d(t)-»0 and the conditional 
probability of making a wrong decision tends to zero for t>0. Note that as 
Oi(t)— c(t)— > 00 , d(t) — and the conditional probability of making a wrong 
decision tends to 1. 

The unconditional probability of a wrong classification can be found by 
taking the expected value of (3.46) with respect to Y(0). It follows from (3.25) 
that Y(0) has a normal distribution with mean gi and variance Oi (°°) 2 + T\ 2 . 
Figures 4 and 5 show the probability of misclassification for the case 
P2(t) S 2 (t) = Pi(t) Si(t), Xi = T 2 = 1, Ot = 02 = 1, gi = 1, P2 = 2 and p = 0.0, 0.5, 0.8, 
0.9, 0.95 (resp. curves A, B, C, D, E). The integration to evaluate the probability 
is performed using Gauss-Hermite quadration with 59 points; cf. A. H. Stroud 
et al. [1066] and Naylor and Smith [1982]. Figure 4 shows the probability of 
wrong classification. For small times t having a larger p results in smaller 
probabilities of error. The probability of wrong classification is small for small 
values of t and then increases to a limiting value as t-»°°. The limiting 
probability of wrong classification increases as p increases. Thus, while for 
small times, having a larger positive p decreases the probability of wrong 
classification, at larger times it increases the probability of wrong 
classification. In Figure 5, each probability of wrong classification is divided 
by its asymptotic (as t— »°°) value. For a fixed time t, for a higher p, the fraction 
of the probability of wrong classification is less than or equal to that for a 
lower p. The higher p is, the longer it takes for the probability of error to 
reach its asymptotic value. 
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PROB OF ERROR;TH1 ~N(MU1 ,TAU);TH2~N(MU2;TAU) 
MU 1=1 ;MU2=2;SIG=1 ;TAU = 1 
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Fi gure 



NORM PROB OF ERROR;TH 1 ^N(MU 1 ,TAU);TH2^N(MU2;TAU) 

MU1 =1 ;MU2=2;SIG=1 ;TAU = 1 
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Fi gu re 



4. Conclusions 



This paper considers a model in which there are ] items each of which has 
a characteristic Signature which varies in time. In the examples studied the 
Signature process of each item is an AR(l)-type process independent of the 
other items. At time 0 the value of a Signature and the identity of the 
corresponding item are known. No further values of Signatures are observed 
until a later time t. At time t > 0, a Signature from an unknown item is 
measured. The problem is to estimate the identity of the item observed at 
time t. The estimation procedure studied is to estimate the identity of the 
unknown item to be that one which maximizes the posterior probability of 
producing the observed signature. The probability of correct identification 
depends on the parameters of the processes and the magnitude of t. The 
smaller t is the greater the probability of correct identification of the unknown 
item. For fixed time t a higher positive correlation results in a lower fraction 
of the probability of wrong classification with respect to its limiting (as t— »«*>) 
value. 

It appears that the problem of this paper resembles the "missing-data 
problem" of statistics; see Little and Rubin (1987). We plan to investigate the 
connection more extensively in future work. 
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